fix(ci): recover main quality gates and deterministic validation by diegosouzapw · Pull Request #18345 · cheaper-inference/OmniRoute

diegosouzapw · 2026-10-27T12:37:03Z

The public main branch has failing quality checks that can make unrelated contributor PRs start red. This PR brings together the recovery work, deterministic validation, and gate contracts needed to distinguish inherited failures from regressions introduced by a contributor.

The current head is e7954576ded1491579b9b436da111d0d72670d2e. Its diff against the observed public main contains 2,167 paths, including the accumulated recovery changes. The final 29-path layer on the frozen 518a9cb0 basis includes:

Five targeted repairs: environment-documentation context, packaging of the build-progress helper, impacted-test selection for shared helpers, ESLint consumer fixtures, and the combo timeout fixture.
Observer parity with the canonical build producer, strict artifact consumption, build identity and independent package checks within the existing deadline.
Deterministic integration distribution through the existing four CI shards, with selector/wrapper contracts and the corresponding observer assertion updated to the final wiring.

The accumulated changes also cover test and data isolation, dependency provisioning and verification, process completion and resource cleanup, explicit i18n comparison context, and the documentation and skill contracts used by the gate. These remain subject to complete current-candidate validation.

⚠️ base-red inherited: #17267. HOLD — not approved for merge. Public refs/heads/main was re-resolved on 2026-11-04 at 26bf6812c06afb33abeb877160585050c0f5ca5d; its exact-base CI run and Quality run failed. This warning does not establish the cause of a failure on the new candidate.

Validation and remaining acceptance

The final repair layer covers 449 unique focused cases: 401 passing cases from 31 preserved results whose inputs were verified unchanged, plus all 48 cases in the corrected observer suite rerun successfully. This is a preserved-results synthesis, not a fresh 449-case run. The initial 448/449 result remains historical RED.
Formatting, normal commit hooks, and the post-commit check:test-masking check passed for the 29-path repair layer. Test masking compared the committed head with 518a9cb0; it does not certify the complete 2,167-path PR diff. The committed tree is f5073a8e1844bbeb1a7418c9ea36ca2213dd3342.
The earlier complete local observer on 518a9cb0 remains RED. Diagnostic runs and full validation of the composed candidate remain pending; focused results do not reclassify historical failures or certify real startup, complete suites, build, package or boot behavior.
The new head triggered CI and Quality Gates, both pull_request, attempt 1. API Route Typecheck, semgrep, opencode-plugin CI and opencode-provider CI were also triggered. Their initial observed state was queued; no current-candidate hosted PASS is claimed.
The PR merge candidate is 1bc7980174d8c7e9f4a536dc34f3e571dd2d76f7, with parents 26bf6812 and e7954576 and the same tree as the committed head. Admission must match this candidate and the exact run/attempt, and must be refreshed if the base or head changes.

protected_surface: true. The diff includes agent guidance, instruction mirrors and quality skill templates. Specific operator approval of the exact protected diff remains required before merge. The PR is ready for checks, with no auto-merge enabled. Full admission, required-check enforcement, incident closure, canaries, deployment and merge remain pending their acceptance steps. Overall status: PARTIAL / NOT CERTIFIED.

…ling

…ent source

…hness

Backport #17226 and use a registered Perplexity model in the delayed persistence fixture. Co-authored-by: Paco Cartones <253313177+pacocartones@users.noreply.github.com>

…andidate

Reconcile immutable OpenAPI baselines, required audits, hosted receipts, workflow pins and cache trust, repository identity and test registration. Co-authored-by: Bob.Hou <houminxi@gmail.com>

…ain-recovery-candidate-20261026

github-actions · 2026-10-30T17:23:55Z

CI Coverage Report

Coverage job: success
PR test policy: success

Coverage artifact was not available for this run.

HouMinXi · 2026-11-02T10:24:59Z

Could you check the full package timeout alongside the remaining validation for 5ef30a12? Its full pack-artifact lane still has a 20-minute budget. In today's main job, build:cli timed out after 1,201,732 ms on 55ccad49.

The main-green-report artifact contains the complete command receipts and assertion stacks:

Seven unit shards failed with 21 top-level failing tests. These include catalog responses returning 503 instead of 200, MITM cleanup state, filesystem fault injection, timing assertions, locale-dependent sorting, and Perplexity stream finalization. The Perplexity wrapper contains four failing child assertions.
Integration has 12 failures: batch E2E reports fetch failed / ECONNRESET; the other 11 inherit server-startup timeouts from the fingerprint and resilience suites' setup hooks.
The report's five HARD entries include the same build timeout under both package validation and build:cli. Boot was skipped because no valid build was produced, so those entries are not five independent defects.

This candidate already changes several relevant paths: isolated hosts fixtures, root-safe filesystem failure injection, fixed locale, throttle timing, child readiness, and early stream-finalizer registration. Those changes still need complete validation on the current candidate; the remaining failures cannot all be attributed to one network warning.

#18693's 40-minute package budget is now exercised on release 075d6e5: full package and installed-CLI boot validation passed. Please check whether that budget change belongs in this main companion and reconcile the artifact's failures with current-head coverage. The release result does not validate this candidate.

coderabbitai · 2026-11-04T15:21:54Z

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

Source mode: Auto
Repository: Unavailable
Branch: Unavailable
File: No configuration file from this repository applied
Commit: Unavailable
Layers: defaults
Review profile: CHILL
Plan: Advanced
Run ID: f1e0e5ef-4a3f-4d73-9977-f433d168adec

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

Trigger review

Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

…aths

diegosouzapw and others added 30 commits October 25, 2026 20:48

fix(ci): make failure signature ordering independent of locale

e26d03e

test(ci): isolate main regression fixtures from host state and schedu…

eed485d

…ling

fix(ci): retire vulnerable dependency chains on main

0ea7675

docs(i18n): recover verified main mirrors and repair English environm…

3e09ee6

…ent source

docs(i18n): sync docs/reference/ENVIRONMENT.md mirrors with the base

424932b

fix(i18n): revalidate cached main documentation before recording fres…

c0db961

…hness

test(ci): backport deterministic fixtures to main

ccccd42

fix(sse): backport early stream finalizer registration to main

ff38a21

Backport #17226 and use a registered Perplexity model in the delayed persistence fixture. Co-authored-by: Paco Cartones <253313177+pacocartones@users.noreply.github.com>

chore(ci): combine main regression fixtures for validation

bf95286

chore(ci): combine main security dependencies for validation

609b7b1

chore(ci): combine main stream finalizers for validation

f65c87f

chore(security): tighten main vulnerability ratchet to zero

c9caf07

chore(ci): include measured main vulnerability baseline in recovery c…

f7fb879

…andidate

docs(i18n): sync docs/reference/ENVIRONMENT.md mirrors with the base

ff8c27b

fix(i18n): backport validated translation retries to main

aff4406

fix(ci): backport complete gate execution and workflow hardening to main

bb9001f

Reconcile immutable OpenAPI baselines, required audits, hosted receipts, workflow pins and cache trust, repository identity and test registration. Co-authored-by: Bob.Hou <houminxi@gmail.com>

docs(i18n): sync docs/reference/ENVIRONMENT.md mirrors with the base

6a91953

docs(i18n): re-adopt target hashes after pre-commit formatting

3c3a330

Merge commit 'bb9001f33e749498fd62909d59a003b0107ad683' into fix/qg-m…

c2a85c5

…ain-recovery-candidate-20261026

Merge commit '3c3a330724b177f47ec800c87a0e248927961f07' into fix/qg-m…

d209a4e

…ain-recovery-candidate-20261026

test(ci): bound UI workers by hosted runner capacity

bedb92f

fix(ci): shard all UI tests with complete receipt validation

a2781d9

fix(ci): require current complete lint measurements for metrics

fc56a57

Merge commit 'fc56a5719605046dde11ecef7585364564b5a32c' into fix/qg-m…

4d700ac

…ain-recovery-candidate-20261026

docs(ci): align main translation source with admission repairs

837a4a8

fix(ci): avoid quadratic message lookup in i18n coverage gates

a8cd208

test(ci): integrate current main lint and locale recovery

4612d09

test(ci): prepare main UI dependencies before assertions

e482ea0

test(ci): integrate main UI preparation proofs

0b18362

docs(i18n): sync README.md mirrors with the base

9272588

diegosouzapw added the protected-surface Touches an agent-instruction surface (AGENTS/CLAUDE/llm.txt/SKILL.md) — per-PR operator OK to merge label Nov 2, 2026

This was referenced Nov 2, 2026

fix(ci): give main full package validation a shared 40-minute budget #18750

Merged

test(chat): assert cooldown wait independently of setup time #18751

Merged

diegosouzapw added 13 commits November 2, 2026 14:37

fix(ci): make quality validation deterministic and complete

4b2bfbe

chore(ci): reconcile current main package validation

83edfcb

fix(ci): isolate unit fixtures and preserve active resource reservations

a83263b

fix(ci): bind hosted suites and persist exact gate receipts

c0172d6

fix(ci): repair observer fixtures and stabilize catalog timeout waves

7b3920f

fix(ci): stabilize batch setup and prevent inherited quality failures

e94cd9e

test: await owned Next workers before batch server teardown

37d91b1

test(ci): make four unit test contracts deterministic

c70ec4b

fix(ci): pin changelog comparisons and validate Trivy policy

08874a5

fix(ci): keep lint measurements separate from process diagnostics

d890883

fix(build): trace package preparation and require prebuilt CI input

2dc8e0b

fix(ci): align integration shards and await direct child cleanup

518a9cb

fix(ci): compose main gate repairs and integration sharding

e795457

diegosouzapw added 11 commits November 4, 2026 16:52

fix(skills): bind release admission and verified i18n state merges

b97d27e

fix(ci): align DAST group methods and management API contracts

1a3687b

fix(ci): authenticate DAST inference coverage and select documented p…

b847dc8

…aths

fix(ci): reserve merge integrity check names for real candidates

9ae2120

test(ci): derive DAST expectations from documented management routes

d7f63bf

fix(ci): harden auxiliary dependencies and JavaScript test gates

f4c167d

fix(ci): compose verified recovery repairs for MAIN

21f6f2a

fix(ci): compose plugin fixtures and common i18n publication guards

8b52ed3

fix(api): document pre-auth key access body limits

f785665

fix(ci): validate scoped DAST body-size rejections

69a3113

chore(ci): compose reviewed OpenAPI contract binding

4a3393e

Navigation Menu

Repository navigation

fix(ci): recover main quality gates and deterministic validation - #18345

fix(ci): recover main quality gates and deterministic validation#18345
diegosouzapw wants to merge 157 commits into
mainfrom
fix/qg-main-recovery-candidate-20261026

diegosouzapw commented Oct 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Oct 30, 2026 •

edited

Loading

Uh oh!

HouMinXi commented Nov 2, 2026

Uh oh!

coderabbitai Bot commented Nov 4, 2026 •

edited

Loading

Review skipped

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

diegosouzapw commented Oct 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Validation and remaining acceptance

Uh oh!

github-actions Bot commented Oct 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI Coverage Report

Uh oh!

HouMinXi commented Nov 2, 2026

Uh oh!

coderabbitai Bot commented Nov 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review skipped

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

diegosouzapw commented Oct 27, 2026 •

edited

Loading

github-actions Bot commented Oct 30, 2026 •

edited

Loading

coderabbitai Bot commented Nov 4, 2026 •

edited

Loading